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Abstract — In this paper, we design and implement time ex- 
change (TE) based cooperative forwarding where nodes use 
transmission time slots as incentives for relaying. We focus 
on distributed joint time slot exchange and relay selection in 
the sum goodput maximization of the overall network. We 
formulate the design objective as a mixed integer nonlinear 
programming (MINLP) problem and provide a polynomial time 
distributed solution of the MINLP. We implement the designed 
algorithm in the software defined radio enabled USRP nodes of 
the ORBIT indoor wireless testbed. The ORBIT grid is used 
as a global control plane for exchange of control information 
between the USRP nodes. Experimental results suggest that TE 
can significantly increase the sum goodput of the network. We 
also demonstrate the performance of a goodput optimization 
algorithm that is proportionally fair. 

Index Terms — Resource Delegation, Cooperative Forwarding, 
Global Control Plane, Testbed Implementation, GNUradio. 

I. Introduction 

Cooperative forwarding improves the connectivity and 
throughput in wireless networks (TJ. However, forwarding 
always incurs some costs, e.g., delay/power, at the forwarder 
node. Hence, there have been recent studies on resource 
delegation based incentivized forwarding |2j-||7j. Resource 
delegation based forwarding allows the sender node to delegate 
a portion of its allotted resource to the forwarder node as an 
immediate incentive for relaying. Previous works on incen- 
tivized forwarding have focused on resource exchange from 
a theoretical perspective and used numerical simulations to 
justify the effectiveness of the approach. The main contribution 
of our work is to demonstrate the advantages of incentivized 
forwarding using the ORBIT indoor wireless testbed [8|. 

We specifically focus on the uplink of an N node time 
division multiple access (TDMA) network where each node 
receives an initial number of time slots and transmits data to 
the base station (BS) through the direct path. In this context, 
we focus on a two hop time exchange (TE) based forwarding 
scheme where the sender node transfers a portion of its allotted 
time slots to the forwarder node as an incentive for relaying. 
The basic idea of TE is illustrated in Fig. [JJ In this example, 
node 1 and 2 initially receive 4 time slots and transmit through 
the direct path. In TE, node 1 performs a half duplex decode 
and forward (DF) relaying of node 2's data and node 2 
delegates one time slot to node 1 as an incentive for relaying. 
Node 2 may attain higher data rate through this cooperation 
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Fig. 1. The motivating scenario for time exchange based cooperative 
forwarding 



since its data goes to the BS through two different paths. Node 
1 may also get higher data rate since it has more transmission 
time slots. The optimal time slot delegation is an important 
question in this context. 

A sender node can delegate time slots to multiple forwarder 
nodes and transmit data to the BS through multiple paths. 
However, the authors of (9) have shown that for a source- 
destination pair, in the presence of multiple relay nodes, it 
is sufficient to select the "best relay node" to achieve full 
diversity order. On the other hand, the assumption of one 
sender node for one forwarder node reduces the relay selection 
complexity. Therefore, we assume one forwarder node for 
one sender node and vice versa in this work. The optimal 
distributed sender-forwarder pair selection problem becomes 
another important question in this context. 

In this work, we address the joint time slot delegation and 
sender-forwarder pair selection question in the context of sum 
goodput maximization of the overall network. We formulate 
the joint optimization problem as a mixed integer nonlinear 
programming (MINLP) problem. Using our relay selection 
work of [5], we show that the distributed solution of the 
MINLP requires 0(k tot ) computational complexity and at 
most N 2 message passing where k tot and N denote the total 
time slots and nodes in the network. The designed algorithm 
maximizes the sum goodput of the network while preserving 
the local goodput of the individual nodes. 

We implement the designed algorithm in the ORBIT in- 
door wireless testbed. We use software defined radio enabled 
USRP (10) nodes of the ORBIT (8) testbed. The ORBIT grid 
serves as the global coordination plane fTT] to exchange the 
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Fig. 2. Direct Transmission and Time Exchange System Model 



protocol information between the nodes. The data transmission 
through the air is processed using the GNUradio codes fl2) . 

Previous works in resource exchange (2)-||7j have focused 
on developing information theoretical algorithms. We design 
the theoretical framework in accordance with the testbed 
constraints and then implement the framework in the ORBIT 
testbed. Our theoretical analysis has similarities to the clas- 
sical maximum weighted scheduling study of p3| . However, 
unlike fl3) , we consider a network where each node starts with 
a fixed number of time slots and then tries to find the optimal 
number of time slot transfers. Our proposed framework can 
be applied to TDMA based commerical (GSM & Edge [14], 
802.16 Wireless MAN (T5)) and tactical (Joint Tactical Radio 
System JIB"] and Link 16 [17]) networks. 

This paper is organized as follows. Sec. [II] and III illustrate 
the system model and design objective respectively. We solve 
the optimization problem in Sec. 
experimental setup in Sec. [VJ we demonstrate 
results in Sec. [VU We conclude the work in IVIII 



After describing the 
the testbed 



II. System Model 

We consider the uplink of an N node single cell TDMA 
network. Let V = {1, 2, • • • , N} denote the set of N nodes 
that transmit data to the BS (node 0). Each node uses the 
same bandwidth. Node i E V is initially allotted time 
slots per second. Without loss of generality, assume one 
packet is transmitted per time slot. Each node is assumed to 
employ a fixed modulation scheme. This assumption is based 
on the testbed implementation constraint and will be further 
explained in the experimental setup section. Due to the fixed 
modulation and total bandwidth usage, the data transmission 
rate of each node depends on the number of allotted time slots. 

We use packet loss probability as the channel strength 
indicator. Let Pe^ denote the packet loss probability in the ij 
path. Define goodput of node i by the number of packets of 
node i that successfully reach the BS. Node i initially transmits 
through the direct link id Hence, the initial goodput of node 
i, Rf 1 , can be found as: 



TABLE I 
Summary of used notations 



Notation 


Meaning 


p p . . 
rK %3 


Packer error probability of the ij link 


fef 


Initial transmission time slot of node i 


kf 


Node i's btransmission time slot in BE 


RT 


Initial goodput of node i 


Rf 


Node i's goodput in TE 


Rij 


Goodput in the ij link 


V 


Set of N nodes 


V 


Set of nodes that transmit without cooperation 


ST 


Set of sender-forwarder pairs 


5J, 


i th sender-forwarder pair (sj,/i) 


s 


Sender node 


f 


Forwarder Node 


k tot 


Total time slots in 1 second 


m 


Number of neighbouring nodes of node i 



node s/s data, along with transmitting /,'s own data. Let 
V = di,d®,--- ,d,L denotes the direct set, i.e., the set of 
remaining nodes that transmit data without cooperation. 

The left and right hand side of Fig. [2] shows the direct 
transmission and TE model of an arbitrary sender-forwarder 
pair (s, /). Node s and / initially receive kf and k\ n time 
slots and obtain Rf and Rf goodput respectively. 

In TE, node s transmits for kf time slots. During kf time 
slots, node s transmits kf packets. Among these packets, 
the BS and node / receive R s o and R s f 'error-free' packets 
respectively. Following the analysis of ([TJ, 



Rs f = kf * (1 - Pe af ) , R s0 = kf * (1 - Pe s 



(2) 



Assume Pe s f < Pe S Q. Hence, R s f > Rfo- Node / acts as a 
forwarder of node s and transmits for kf time slots. During 



these time slots, kf * (1 — Pefo) packets 'successfully' reach 



the BS. Assume, 



R 



f 



R c = kf*{l-Pe f0 ) 



(3) 



Here, Rf denotes the number of 'error-free' packets that 
contain node /'s own data. R c represents the number of 'error- 
free' packets that contain node s's data and are forwarded by 
node /. 

Let Rf denote the goodput of node s in TE. Also assume 
that when node s transmits, the packets that get 'lost' at node 
/ (the closer node), also get 'lost' at node (the far node). 
Based on this assumption and using the max-flow-min-cut 
theorem fT8l, 



Rf <mm(R 8f ,R a0 + Rc) 



(4) 



R'; 



R l0 = kf 1 * (1 - Pe M ) 



(1) 



Based on this goodput analysis, we focus on the distributed 
joint optimal time slot exchange and relay selection in the sum 
goodput maximization of a TE network. 



A. Goodput Analysis in TE 

In TE, nodes perform two hop half duplex decode and 
forward (DF) relaying. Let, SP = {SPi,--- 7 SPk} = 
{(s%, fi), (s 2 , h), ■■■ , {skJk)} denote the sender-forwarder 
pairing sets, i.e., the forwarder node /j relays the sender 



III. Design Objective 

Problem I 

max . Rd + E ( R f + R s B ) < 5a > 

deV (s,/)G5J r 
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s.t. (Rf,Rf) € conv(kf,kl e ) V(s,/) G ST (5b) 
Rf > Rf , R l s e > Rf V (s, /) G ST (5c) 



kf + kf < k} n + k l s n , (kf,kf) G Z+, V(s,/) G S.F (5d) 
#d = * (1 - Pedo), kf = kf, VdeV (5e) 



PCV,5JeVxV, ST, n 5Jj = Vi ^ j (5f) 
STiHV = 0Vi G [l,iT] (5g) 
5J"i U SJ" 2 • • ■ U U V = V (5h) 

Variables V,ST, Rf , Rf, kf ,kf 

Equation ( |5e| ) and ([TJ suggest that Rf = _R™. Therefore, 
the goodputs of the nodes in the direct set T> are not optimiza- 
tion variables. Equation |5b) denotes that the goodputs of the 
forwarder and sender remain in the convex hull of the allotted 
time slots, kf and kf. This convex hull is governed by |2]) 
and ([3]). Equation ( |5c| ensures that the goodputs of the sender 
and the forwarder through TE don't drop below their initial 
goodputs. Equation ( fSd} shows that the total time slots used 
by the sender and forwarder are constrained by the summation 
of the initial time slots allotted to those nodes. Equation (|5f|l- 
(|5h]» denote that the direct node set and the sender-forwarder 
pairs cannot have any common node and together, they form 
the overall set V. 

Problem I is similar to the design objective of our earlier 
work on bandwidth exchange |5j. However, we focused on 
information theoretic capacity |M9| based resource allocation 
and relay selection in 15}. In this work, we focus on packet 
error probability based goodput maximization, which is a 
tangible objective in an indoor wireless testbed. 

The convex constraint of the discrete time slot alloca- 
tion and the sender-forwarder pair selection objectives make 
problem I a mixed integer nonlinear programming (MINLP) 
problem. The solution of this MINLP involves an exponential 
number of variables and constraints. In the next section, we 
focus on designing a polynomial time distributed solution of 
problem I. 

IV. Optimization Problem Solution 

Let R to t = Sigv ^i™ denote the summation of the initial 
goodputs of the nodes. For a fixed SJ 7 , Rtot can be expressed 



in the following form: 

D \ pin 

iev 

= E^"+ E (R? + K n ) (6) 

d<EX> (s,/)e<S.F 

= E^ e + E (Rf + RT) (7) 

dex> (s,/)es.F 

Equation uses the fact that Rf — R^Vd G D. Subtracting 
Rtot from the objective function of I, we find the following 
optimization problem: 
Problem II 

max. (Rf + Rf ~ Rf ~ Rf) (8a) 

s.t. (Rf,Rf) G conv(kf,kf) V(s,/) G ST (8b) 
Rf > Rf , Rf > Rf V (s, f) G ST (8c) 

kf + kf < kf + kf, {kf,kf) G Z+, V(s,f) G ST (8d) 

V CV , ST eV xV , STi fl STj =®yi^j (8e) 
STiDV = 0Vi G [1,K] (8f) 
STi\JST 2 ---^ST K \JV = V (8g) 

Variables V,ST, Rf, Rf, kf, kf 

The inclusion of constant terms does not change the optimal 
variables of an optimization problem (20| . Therefore, the 
optimal variables of both problem I and II are same. We focus 
on solving problem II in the subsequent analysis and use the 
optimal variables to find the solution of problem I. 

Problem II involves both sender-forwarder pair selection and 
discrete time slot allocation features. For a fixed set of sender- 
forwarder pairs, the constraints in ( [8b] i- ( (Sd} ensure that the 
discrete time slot exchange in one pair does not affect the other 
pairs. Hence, we now focus on an arbitrary sender-forwarder 
pair (s, f) and find the discrete time slot exchange in this pair. 

A. Time Slot Allocation for a Fixed Sender Forwarder Pair 
Problem III 

max (Rf - Rf) + (Rf - Rf) (9a) 

R sf - kf * (1 - Pe sf ) , R s0 = kf * (1 - Pe sQ ) (9b) 

Rf + R C = kf * (1 - Pe /0 ) , Rf < mm(R sf ,R sQ + R c ) 

(9c) 
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Rf > Rf , Rf > R™ (9d) 
kf + kf < kf + kf , (kf, kf) e Z+ , (9e) 

variables R c , R sf , R s0 , Rf, Rf, kf, kf (9f) 

Lemma 2: Problem III is concave if (kf ,kf) G 7£. + . 

Proof: The objective function in ( |9a] > and the constraints 
in ( |9b") , (j9cj and |9e} are linear. Minimum of linear (concave) 
functions is concave p0| . Hence, the constraint in ( |9c| ) is 
convex. Thus, problem III is a concave maximization problem 

if {kf,kf) e n+. m 

The internal concave structure of problem III allows us to 
generate an upper and lower bound of problem III. 

1) Upper Bound: Let us modify problem III by relaxing 
the integer time slot constraint, i.e., let us assume {kf, kf) € 
1Z + . Let's call it problem IV. Now, the feasible region of the 
modified problem is a superset of that of problem III. Hence, 
the optimal solution of the modified problem is an upper bound 
of problem III. Denote this upper bound by vP. 

2) Lower Bound: Let kf'* and kf'* denote the optimal 
time slot solutions of problem IV. Now, if kf'* and kf'* are 
integers, they are also the optimal solutions of problem III. 
Otherwise, convert kf'* and kf'* to the nearest integers and 
find the corresponding goodputs. If the corresponding solution 
is feasible for problem III, it can serve as a lower bound to 
the optimal solution of problem III. Denote this lower bound 
by 1°. 

3) Computational Complexity of Problem III: Probelm III 
can be optimally solved by searching over k z s n time slot 
transfers. However, one can further reduce the complexity 
by solving the convex programming based upper and lower 
bounds of problem III. Let e denote the tolerance of the 
optimal solution. If (uq — lo) < e, we can use the lower bound 
as the solution of problem III. 

B. Optimal Sender Forwarder Pair Selection 

The optimal solution of problem III denotes the sender- 
forwarder pair's goodput gain through cooperation, over non- 
cooperation. The optimal relay selection part of problem II 
is to find the set of sender-forwarder pairs that maximizes 
the summation of the goodput gain. Now, consider a graph 
Q = (V,£) where the vertices V represent the set of N 
nodes under consideration and £ denotes the edges between 
these nodes. Define the edge weight of any pair by 

Rf + Rf — R\ n — Rf 1 , i.e., the difference, in terms of good- 
put, between the cooperation and non-cooperation scenario. 
Using the interference-free scheduling algorithm of [13], the 
optimal sender-forwarder set selection problem can be shown 
to be equivalent to solving the maximum weighted matching 
(MWM) algorithm |21| in the above graph. A detailed proof 
of the equivalence between the relay selection problem and the 
MWM algorithm can be found in [5|. The next section will 
illustrate the use of MWM in the optimal sender-forwarder 
pair selection among 3 testbed nodes. 




Fig. 3. Orbit Testbed 

The MWM algorithm can be distributively solved using the 
distributed local greedy MWM (22). Distributed MWM finds 
the pairs by selecting the locally heaviest edges and guarantees 
at least 50% performance of the optimal solution of problem 
I J22) . Our distributed TE implementation protocol is based 
on the distributed MWM and will be described in the next 
section. 

C. Distributed TE Protocol 

1) Node i £ V has k" 1 transmission time slots and knows 
the packet error probability of its direct path, Pe^, 

2) Let J be the set of neighbours of i. In a wireless 
environment, neighbouring nodes can hear each other. 
Node j 6 J receives node i's packets and can calculate 
the inter-node packet error probability, Peij. 

3) Node i sends an omnidirectional message containing 
Pe^o and k™- to its neighbours. 

4) Node i solves problem III for all j & J and finds the 
goodput gain for each of its neighbours. Thus, node i 
knows its adjacent link weights. 

5) Node i picks the "candidate" node j, based on the 
heaviest adjacent link weight and sends "add" request. 

6) If node i receives an "add" request from node j, i and 
j form a cooperative pair. Node i sends "drops" request 
to its other neighbours. 

7) If node i receives a "drop" request from j, node i 
removes the (i, j) link from its adjacent edge set. Node 
i returns to step 5. 

8) The pair selection process converges after at most iV 2 
message passings. The 'matched' nodes form the set of 
cooperative pairs SJ-. The 'unmatched' nodes form T> 
and transmit data without cooperation. 

9) The sender node s of a cooperative pair transmits its 
own data during kf time slots. 

10) The BS sends ACK of the 'correctly' received packets 
to the sender node. The forwarder node also hears these 
ACK messages. Based on this information, node / finds 
the packets of s that got 'lost' at the BS. 

11) Node / transmits for kf time slots. During these slots, 
node / forwards the 'lost' packets of s and then trans- 
mits its own data packets to the BS. 

D. Computational Complexity of the Distributed Algorithm 

Each node i G V solves problem III for each of its 
neighbours. Let rii be the number of neighbours of node 



Fig. 4. USRP Daughterboards 



i. Since problem III can be optimally solved using 0{kf l ) 
searches, each node performs 0(riikj n ) computations. The 
total number of computations in the N node network is 

0(n,kl n N). 

The number of time slots allotted to node i, kf 1 , can be 
approximated as, k\ n ~ K^. Since rii « k tot , the overall 
complexity is, O(k tot ). 

Thus, the proposed TE protocol solves an approximated 
distributed version of problem I with O(k tot ) complexity and 
at most iV 2 message passings. 

V. Experimental Setup 
A. ORBIT Testbed & USRP Nodes 

We implement the proposed TE based incentivized algo- 
rithm among the USRP nodes of ORBIT, an indoor wireless 
testbed of Wireless Information Network Laboratory (WIN- 
LAB), Rutgers University. ORBIT has 400 nodes, overall, in 
a 20m x 20m square grid. Fig. [3] shows a snapshot of the 
ORBIT testbed. 

ORBIT has 15 USRP nodes that can be used in software 
defined radio based experiments. Fig. |4] shows the snapshots 
of two USRP daughter boards. We use the GNU radio soft- 
ware toolkil (TZ) to run experiments in these USRP nodes. 
Specifically, we use the benchmark-tx.py and benchmark- 
rx.py codes to transmit and receive packets between two 



Fig. 5. Spatial Separation of Selected Nodes 



USRP nodes (12). The flexibility of GNUradio allows us to 
change the transmission power level and packet sizes through 
software. This variable power capability of GNUradio, along 
with the spatial separation among the nodes, allow us to create 
links with different strengths between different node pairs. 

As shown in Fig. [5] we use four USRP nodes of the ORBIT 
testbed to conduct the TE based cooperative forwarding exper- 
iments. Fig. [5] also shows the spatial separation of the selected 
nodes. Here, node 1, 2 and 3 constitute the user set V and node 
serves as the BS. The ORBIT grid is used as a global control 
plane to exchange the control information between the nodes. 

B. Selection of Parameters 

The benchmark-tx.py and benchmark-rx.py codes of GNU- 
radio allow the following four modulation schemes: a) GMSK, 
b) differential binary phase shift keying (DBPSK), c) differen- 
tial quadrature phase shift keying (DQPSK) and d) differential 
8 phase shift keying (D8PSK). DBPSK, DQPSK and D8PSK 
are found to be very sensitive to peak power clippings due to 
their variable envelope waveform. Therefore, we use a fixed 
modulation scheme, GMSK, in our experiments. 





Fig. 6. Illustration of MWM in sender-forwarder pair selection 

Each node transmits at 1 Mbps and each packet contains 
1500 bytes. As a result, it takes (1500 * 8)/(l * 10 6 ), i.e., 
0.012 second to transmit one packet. We assume each time 
slot to be 0.012 second long, i.e., one packet is transmitted in 
each slot. 

The total transmission time is assumed to be 3 second. 
Each node is initially allotted 1 second transmission time, i.e., 
1/0.012 or 83 time slots. We approximate the number of time 
slots since fractional packet transmission is not considered. 

We also add 32 bit CRC sequence in each packet and make 
it similar to the Ethernet packet structure (23) . Note that, we do 
not use error control coding in these experiments. Therefore, 
the presence of a single bit error leads to the 'loss' of the 
whole packet due to CRC. 

VI. Experimental Evaluation 

A. Illustration of MWM in Relay Selection 

Fig. [6] shows the use of MWM in the optimal sender- 
forwarder pair selection among 3 testbed nodes. The left figure 
of the top row shows the packet loss probability between the 
inter-node pairs. These packet error probabilities were based 
on 1500 byte packet length, GMSK modulation, some fixed 
power level and CRC checking. The middle figure of the top 
row focuses on the direct transmission scenario and shows the 
goodput (in packet/3 second) of each node. Each node initially 
receives 83 time slots and transmits one packet at each slot 
through the direct path. The packet error probability in link 30 
is 0%. Therefore, all transmitted packets of node 3 reach the 
BS. Node 1 and 2's goodputs are considerably lower due to 
the high packet error probability in link 10 and 20 respectively. 
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Fig. 7. Sum Goodput Maximization in 3 node (Packet length = 1500 bytes, 
CRC checking, OMSK modulation) 



The top right, the bottom left and the bottom middle figure 
show the goodput (in packet/3 second) of different sender- 
forwarder cooperation scenarios. The top right figure focuses 
on the TE based cooperation between node 1 and 3. Here, node 
1 and 3 solve the two node time slot allocation optimization 
of problem III. The cooperation allows node 3 to achieve a 
goodput of 132 packets and ensures that node l's goodput 
does not drop below 18 packets, its initial value. Therefore, 
the overall goodput gain obtained through the cooperation of 
node 1 and 3 is 49 packets. As a result, the 13 link of the 
MWM graph, shown in the bottom right figure, is assigned a 
weight of 49. 

The bottom left and bottom middle figures demonstrate the 
cooperation scenario in node 1-2 and 2-3 respectively. The 
bottom right figure shows the link weight of the corresponding 
cooperation pairs. The distributed local greedy MWM selects 
link 13. Therefore, node 1 and 3 cooperate using TE, whereas, 
node 2 transmits without cooperation. 

B. Sum Goodput Maximization 

Fig. [7] compares the sum goodput (in kilo bit per second 
(kbps)) of TE and direct path transmission. Fig. [6] shows that 
node 1 and 3 get selected as the cooperative pair due to the 
MWM algorithm. Therefore, node 1 and 3 solve problem III 
to find the optimal time slot transfers. Due to the sum goodput 
maximization objective, the benefits of cooperation go to node 
3, i.e., the node with the better channel. Node 3's goodput 
increases by 70%. The constraint of ( |9dl > ensures that node 
1 gets its initial goodput, at least. On the other hand, node 2 
transmits without cooperation and its goodput does not change 
from the initial value. 

C. Proportional Fair Maximization of Goodput 

Fig. [8] compares the proportional fair maximization per- 
formance of direct transmission and TE. Here, the selected 
cooperative nodes, s and /, solve a modified version of 
problem III. In this modified problem, s and / maximize 
(Rf -Rf)* (Rf - Rf) instead of maximizing (Rf + Rf). 
Hence, the goodput of both nodes increase due to cooperation. 
Fig. [8] shows that the goodputs of node 1 and 3 increase by 
70% and 30% respectively. 




Fig. 8. Proportional Fair Maximization of Goodput (Packet length = 1500 
bytes, CRC checking, OMSK modulation) 



VII. Conclusion 

We designed and implemented TE based cooperative for- 
warding among the USRP nodes in the ORBIT indoor wireless 
testbed. We solved the joint time slot allocation and sender- 
forwarder pair selection problem in this setup. Our proposed 
algorithm maximizes the global goodput of the network while 
ensuring that no node's goodput drops below its initial value. 
The ORBIT grid is used as a global control plane to exchange 
the control information between the USRP nodes. Experimen- 
tal results suggest that resource delegation based cooperative 
forwarding can significantly improve the sum goodput and 
proportional fair goodput performance of the network. 

The use of adaptive modulation and signal to noise ratio 
based resource allocation in testbed implementation remains 
an area of future research. 
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